An Analytical Approach to Neuronal Connectivity 
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This paper describes how realistic neuromorphic networks can have their connectivity properties 
fully characterized in analytical fashion. By assuming that all neurons have the same shape and are 
regularly distributed along the two-dimensional orthogonal lattice with parameter A, it is possible 
to obtain the accurate number of connections and cycles of any length from the autoconvolution 
function as well as from the respective spectral density derived from the adjacency matrix. It 
is shown that neuronal shape plays an important role in defining the spatial spread of network 
connections. In addition, most such networks are characterized by the interesting phenomenon 
where the connections are progressively shifted along the spatial domain where the network is 
embedded. It is also shown that the number of cycles follows a power law with their respective 
length. Morphological measurements for characterization of the spatial distribution of connections, 
including the adjacency matrix spectral density and the lacunarity of the connections, are suggested. 
The potential of the proposed approach is illustrated with respect to digital images of real neuronal 
cells. 

PACS numbers: 89.75.Fb, 87.18.Sn, 02.10.Ox, 89.75.Da, 89.75.Hc 
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A particularly meaningful way to understand neurons 
is as cells optimized for selective connections, i.e. con- 
necting between themselves in a specific manner so as 
to achieve proper circuitry and behavior. Indeed, the 
intricate shape of dendritic trees provide the means for 
connecting with specific targets while minimizingboth 
the cell volume and the implied metabolism (e.g. [EH])- 
While great attention has been placed on the importance 
of synaptic strength over the emerging neuronal behav- 
ior, geometrical features such as the shape and spatial 
distribution of the involved neurons play a particularly 
important role in defining the network connectivity. In 
addition, the topographical organization and connections 
pervading the mammals' cortex provide further indica- 
tion that adjacencies and spatial relationships are funda- 
mental for information processing by biological neuronal 
networks. The importance of neuronal geometry has 
been reflected by the growing number of related works 
(see, for instance, @). However, most of such approaches 
target the characterization of neuronal morphology in 
terms of indirect and incomplete measures such as area, 
perimeter and fractal dimension of the dendritic and ax- 
onal arborizations, to name but a few. Interesting ex- 
perimental results regarding the connectivity of neuronal 
cells growth in vitro have been reported in 0, and 
what is possibly the first direct computational approach 
to neuronal connectivity was only recently reported in 
0, involving the experimental estimation of the critical 
percolation density as neuronal cells are progressively su- 
perposed onto a two-dimensional domain. At the same 
time, the recent advances in complex network formalism 
( e -g- E3 EH 113 ) provide a wealthy of concepts and 
tools for addressing connectivity. Initial applications of 
such a theory to bridge the ga p b etween neuronal shape 
and function were reported in |12l fl3| . 

As such developments are characterized by computa- 



tional approaches involving numerical methods and sim- 
ulation, a need arises to develop an analytical frame- 
work for neuromorphic characterization that could lead 
to additional insights and theoretical results regarding 
the relationship between neuronal shape and function. 
The current paper describes how regular neuromorphic 
complex networks can be obtained and their connectiv- 
ity fully characterized in analytical terms. By regular it 
is meant that all cells have the same shape and are reg- 
ularly distributed along the two-dimensional orthogonal 
lattice with parameter A. Such a kind of networks can 
be considered as models of biological neuronal networks 
characterized by planarity and morphologic regularity, as 
is the case with ganglion cell retinal mosaics [l4( and the 
basal dendritic arborization of cortical pyramidal cells. 

Let the neuronal cell be represented in terms of the 
triple X] = [A, S, D] where A is the set of points be- 
longing to its axonal arborization, S is the set of points 
corresponding to the respective soma (neuronal body) 
and D are the dendritic arborization points. For sim- 
plicity's sake, a finite and discrete neuronal model is 
considered prior to its continuous general formulation. 
We therefore assume that the points used to represent 
the neuron belong to the square orthogonal lattice SI = 
{1,2,..., N} x {1, 2, ... , N}, with parameter A = 1. The 
axon and soma are represented by a single point each, i.e. 
A = a and S = s. Such points could be understood as 
corresponding to the tip of the axon and the soma cen- 
ter of mass, respectively. The dendritic arborization is 
represented in terms of the finite set of dendrite points 
D = D%, D2, . . • , Dm, and it is henceforth assumed that 
a dendrite point never coincides with the axon. Figure ^ 
illustrates such a geometrical representation for a neuron 
with 3 dendrite points. Observe that the coordinate ori- 
gin coincides with the axon, which is taken as reference 
for the soma and dendrite coordinates. 
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FIG. 1: The geometry of a simplified neuronal cells repre- 
sented in terms of its axon A, soma centroid S and dendrite 
points Di. 
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FIG. 2: The neurons connected to neuron i through unit- 
length paths can be obtained through the convolution between 
the position of neuron i with the dendritic shape. 



Neuromorphic networks (actually digraphs Q) can 
now be obtained by placing one such a neuron at all possi- 
ble nodes of the orthogonal lattice f2. By fully character- 
izing such neuronal architectures, the connections estab- 
lished whenever an axon is overlaid onto a dendrite point 
(no connections with soma are allowed) stand out as 
particularly important features of the obtained network. 
Consequently, it is important to obtain analytical expres- 
sions fully characterizing neuronal connectivity, in the 
sense of the spatial distribution of paths and cycles of any 
specific length. We start by considering the connections 
initiated from a single specific neuron i placed at position 
p. As illustrated in Figure [3 the three neurons identified 
by the vectors C\ = p—di—s, c 2 = p—d 2 —s, c 3 = p—d-^ — s 
are directly connected to i through paths of unit length. 
As is clear from such a construction, the set of neurons 
connected to i through unit-length paths can be obtained 
by convolving the initial point S {p} with the function 

g(x, y) = 5 |— d\ — s \ + S |— d 2 — s*| + S |— d 3 — s|. In 

other words, given a set of initial neurons with axons 
located at ^(x,y), the number x(x,y) of connections re- 
ceived from that set by a neuron at position (x, y) is 
obtained as in Equation ^ The binary-valued (1-true, 
0-false) function ^(a;,j/) given in Equation indicates 
whether there is a unit-length path between the neuron 
at {x,y) and the initial set of points £,{x,y), where </>() 
is the hard-limiting function. The functions expressing 
the number of connections of length k between £(cc, y) 
and the neuron at position {x 1 y) and the presence of at 
least one such a connection at that position are given 



by Equations [3] and respectively. The total number 
of connections from length 1 to A: received by the neu- 
ron located at position (x, y) from £(x, y) is given as in 
Equation^ Observe that the use of the Dirac delta func- 
tion in such a formulation allows the immediate exten- 
sion of such results to continuous spatial domains. It 
should be also observed that the above framework can 
be immediately extended to generalized axons by having 
the dendritic arborization to undergo Minkowski dilation 
|15| with the axonal shape and considering as axon only 
the single point corresponding axon a reference along its 
shape. While the analytical characterization of the con- 
nectivity of the considered network models has been al- 
lowed by the fact that identical neuronal shapes are dis- 
tributed along all points of the orthogonal lattice, it is 
interesting to consider extensions of such an approach to 
other situations. An immediate possibility is to consider 
sparser configurations, characterized by larger lattice pa- 
rameters A. Such an extension involves sampling the 
neuronal cell image at larger steps. 

x(x,y) = g{x,y)*£,(x,y) (1) 
v(x,y) = <f)[x{x,y)) (2) 
Xk(x,y) = g(x,y) * ... * g(x, y) £(x, y) (3) 

kx 

Vk{x,y) = cf)(xk(x,y)) (4) 

k 

Tk(x,y) =^2(Xj(x,y)) (5) 
j=i 

Figure 13 shows two digital images obtained from real 
ganglion cells, (a) and (b), and their respective functions 
Xk{x, y) for k — 2 to 4. The axon has been placed over 
the centroid of the neuronal shape (including soma and 
dendrites), whereas the dendritic trees have been spa- 
tially sampled into 2033 and 671 pixels, respectively. Fig- 
ure^] shows Xk(x,y) obtained for the cell in Figurc^a) 
but with the soma located at the cell center of mass, 
which is displaced from the cell centroid by s = (0,7). 
It is clear from such results that the neuron morphol- 
ogy strongly determines the connectivity between cells 
in two important senses: (i) the spatial scattering of the 
dendrite points influences the spatial connectivity distri- 
bution and (ii) the relative position of the axon defines 
how the centroid of the connections shifts for increas- 
ing values of k. While the increased number of synap- 
tic connections implied by denser neuronal shapes is as 
expected, it is clear from the example in Figure 01 that 
the distance from axon to cell center of mass implies a 
coordinated spatial shifting of connections as their re- 
spective lengths are increased. Given the predominantly 
two-dimensional structure of the mammals' cortex, such 
an effect provides an interesting means to transmit infor- 
mation horizontally along such structures. As the proper 
characterization, classification, analysis and simulation of 
neuromorphic networks are all affected by these two in- 
teresting phenomena, it is important to derive objective 
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FIG. 3: Two real neuronal cells (a-b) and their respective 
total number of connections of length k = 1 (c-d) and 2 (e-f). 
The axon has been placed at the cell centroid (considering 
soma plus dendrites) . The neuronal cell figures in (a) and (b) 
are adapted with permission from |l4| . 
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(c) 



(d) 



FIG. 4: The total number of connections of length k — 1 (a), 
2 (b), 3 (c) and 4(d) for the neuronal cell in Figure |3J a) with 
the axon placed over the cell centroid, which is itself displaced 
from the cell centroid by s = (0, 7) pixels. 



related measurements. Let P(x, y) be a density func- 
tion obtained by normalizing Xk(x,y). Thus, the spatial 
scattering of the connections can be quantified in terms 
of the respective covariance matrix Kk, and the spatial 
displacement of the centroid of P{x, y) can be quantified 
in terms of the 'speed' v = \\s\\. Additional geometrical 
measurements of the evolution of the neuronal connectiv- 
ity that can be derived from the covariance matrix K in- 
clude the angle that the distribution main axis makes 
with the x-axis and the ratio between the largest and 
smallest respective eigenvalues. 

Another interesting network feature related to connec- 
tivity is its number Cg.k of cycles of length I established 
by the synaptic connections. This feature can be calcu- 
lated from the enlarged matrix A obtained by stacking 
the columns of the matrix where the neuronal cell image 
is represented in order to obtain the rows of A, while the 
reference point of the cell is shifted along the main diag- 
onal of A. Observe that the image size N x N has to be 
large enough in case dynamics near the toroidal bound- 
ary conditions are to be avoided. The A 2 eigenvalues 
of the thus obtained adjacency matrix Q of the whole 
two-dimensional network are henceforth represented as 
A,-, i = 1, 2, . . . , TV 2 . As A is circulant, these eigenvalues 
can be immediately obtained from the Fourier transform 
of its first row. Observe that the simplicity and speed 
of such an approach allow for systematic investigation of 
a variety of different neuronal shapes. As the cell ref- 
erence point is assumed never to coincide with a den- 
drite point, we also have that ^r=i Xr = ^- As A is a 
non-negative matrix, there will always be a non-negative 
eigenvalue Am, called the dominant eigenvalue of A, such 
that A r < A m for any r — 1, 2, . . . , N. The (unnormal- 
ized) cycle density of T, defined in Equation El provides 
a clear characterization of the network cycles in terms of 
their respective populations. The total number of cycles 
up to length P is defined as T — J2p=i Mp)- The spec- 
tral density (e.g. Q) of the adjacency matrix, defined in 
Equation where A p is the p— th eigenvalue of A, pro- 
vides an additional way to characterize the topology of 
the obtained networks. 



*(t)=5>(pw*-p) 



P =i 



i N 



(6) 
(7) 



r=l 



It is interesting to note that as the maximum length p 
in Equation increases, the number of cycles with that 
length can be approximated as A(p) = X P M , i.e. the dy- 
namics of p is defined by the dominant eigenvalue of A, 
and the distribution of A(p) tends to follow a power law. 
The eigenvalue Xm, which depends on the specific dy- 
namics through which new edges are incorporated into 
the network, therefore represents an interesting parame- 
ter for characterizing the cyclic composition of complex 
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(a) (b) 

FIG. 5: Spectral density of the adjacency matrices obtained 
for the neuronal cells in Figure |3] considering A = 1 (a) and 
A = 5 (b). The crossed lines referes to the sparser neuronal 
cell. 
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(a) (b) 

FIG. 6: Lacunarities for the spatial distributions of connec- 
tions for the cells in Figure 

networks. FiguresEt a ) and (b) show the real part (recall 
that the adjacency matrix for a digraph is not necessar- 
ily symmetric) of the spectral density of the adjacency 
matrices obtained for the neuronal cells in Figure Eta) 
and (b) considering A = 1 and 5. The wider dispersion 
of the spectrum of the denser cell in Figure Eta) reflects 
a higher potential for connections of that neuron in both 
cases. It is also clear that the separation of cells by A = 5 
leads to a substantially smaller spectrum, with immedi- 
ate implications for the respective neuronal connectivity. 



An additional morphological property of the spatial 
distribution of the connections is their respective lacunar- 
ity (e.g. 0|), which expresses the degree of translational 
invariance of the obtained densities. Figure El shows the 
lacunarities of the connection densities obtained for the 
two considered cells with respect to k = 1 to 4. It is 
interesting to observe that most of the lacunarity differ- 
ences are observed for k = 1, with similar curves be- 
ing obtained for larger values of k. At the same time, 
the denser cell led to lower lacunarity values. Given 
their immediate implications for neuronal connectivity, 
the above proposed set of neuronal shape measurements 
present specially good potential for neuron characteriza- 
tion and classification. 

In addition to paving the way for the complete analyt- 
ical characterization of the connections in regular neuro- 
morphic networks in terms of paths and cycles, the frame- 
work proposed in this article can be immediately adapted 
to express the spread of neuronal activity starting from 
the stimulus £(x, y). The neurons are understood to ac- 
cept input and produce output in synchronous manner at 
each clock cycle T. For instance, the situation where the 
neuronal cell output corresponds to the inner product be- 
tween its shape and the respective area of the input space 
can be immediately characterized in terms of the eigen- 
values and eigenvectors of precisely the same adjacency 
matrix A constructed as described above. Although the 
proposed methodology assumes identical, uniformly dis- 
tributed neuronal cells, it is expected that they provide a 
reference model for investigating and characterizing real 
networks characterized by a certain degree of regularity, 
such as some subsystems found in the retina and cor- 
tex. Mean-field extensions of the reported approach are 
currently being investigated. 
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